|
|
Network Traces Analysis Using Apache Spark
Béder, Michal ; Veselý, Vladimír (referee) ; Ryšavý, Ondřej (advisor)
The aim of this thesis is to show how to design and implement an application for network traces analysis using Apache Spark distributed system. Implementation can be divided into three parts - loading data from a distributed HDFS storage, supported network protocols analysis and distributed data processing. As a data visualization tool is used web-based notebook Apache Zeppelin. The resulting application is able to analyze individual packets as well as the entire flows. It supports JSON and pcap as input data formats. The goal of the application is to allow Big Data processing. The greatest impact on its performance has the input data format and allocation of the available cores.
|
|
|
DCSN: Platform for Distributed Computing in Small Networks
Háva, Jakub ; Marek, Lukáš (advisor) ; Falt, Zbyněk (referee)
This thesis describes the platform for distributed computing in small networks. The platform should be very easy to use and suitable for deployment typically in one local network. The implementation follows the client-server architecture and the communication between client and server is based on Remote Method Invocation. The server is responsible for tasks distribution and other computation management. The client receives commands from a user, mediates communication with the server and is also used for the processing of tasks received from the server. The user submits a computation project consisting of two parts: a zip archive containing data files and a JAR archive containing a configuration file together with Java classes needed for the computation on the user data. The user is allowed to query the project state, pause, download or abort the project computation. Powered by TCPDF (www.tcpdf.org)
|
|
|
History and Backup Support for zlomekFS
Wartiak, Rastislav ; Babka, Vlastimil (advisor) ; Obdržálek, David (referee)
zlomekFS is a distributed file system that supports disconnected operation using local cache. During synchronization of local changes it offers easyto-use conflict resolution mechanism. Further improved it became a file system with no specific kernel code. It has therefore a good potential in future public use. As the content of this file system can be updated by many users, keeping history of the changes can be a useful feature. This thesis implements file versioning in zlomekFS, answering the questions such as how to store and access the history. On top of the versioning, the possibility of consistent backup is introduced into the file system. New functionality is derived from the analysis of other file systems with similar features and selection of the most suitable approach for zlomekFS.
|
|
|
Network Traces Analysis Using Apache Spark
Béder, Michal ; Veselý, Vladimír (referee) ; Ryšavý, Ondřej (advisor)
The aim of this thesis is to show how to design and implement an application for network traces analysis using Apache Spark distributed system. Implementation can be divided into three parts - loading data from a distributed HDFS storage, supported network protocols analysis and distributed data processing. As a data visualization tool is used web-based notebook Apache Zeppelin. The resulting application is able to analyze individual packets as well as the entire flows. It supports JSON and pcap as input data formats. The goal of the application is to allow Big Data processing. The greatest impact on its performance has the input data format and allocation of the available cores.
|
|
|
Assessing Usability of Raspberry Pi for Distributed Computing
Stefan, Petr ; Kruliš, Martin (advisor) ; Jančík, Pavel (referee)
The main objective of the presented work is to assess performance of Raspberry Pi micro- computer and its applicability as a work node of a computational cluster. The thesis conta- ins implementation of set of tests that evaluate the CPU performance as well as the throu- ghput of operation memory, persistent storage (SD card), and Ethernet network adapter. The results of comparison of empirical results obtained from Raspberry Pi and representa- tives of regular computers provided basis for recommendation, whether a construction of Raspberry Pi cluster is feasible. Furthermore, the results allowed us to make an estimation of economical and performance aspects of the solution. 1
|
|
|
DCSN: Platform for Distributed Computing in Small Networks
Háva, Jakub ; Marek, Lukáš (advisor) ; Falt, Zbyněk (referee)
This thesis describes the platform for distributed computing in small networks. The platform should be very easy to use and suitable for deployment typically in one local network. The implementation follows the client-server architecture and the communication between client and server is based on Remote Method Invocation. The server is responsible for tasks distribution and other computation management. The client receives commands from a user, mediates communication with the server and is also used for the processing of tasks received from the server. The user submits a computation project consisting of two parts: a zip archive containing data files and a JAR archive containing a configuration file together with Java classes needed for the computation on the user data. The user is allowed to query the project state, pause, download or abort the project computation. Powered by TCPDF (www.tcpdf.org)
|
|
|
History and Backup Support for zlomekFS
Wartiak, Rastislav ; Babka, Vlastimil (advisor) ; Marek, Lukáš (referee)
zlomekFS is a distributed file system that supports disconnected operation using local cache. During synchronization of local changes it offers easytouse conflict resolution mechanism. Further improved it became a file system with no specific kernel code. It has therefore a good potential in future public use. As the content of this file system can be updated by many users, keeping history of the changes can be a useful feature. This thesis implements file versioning in zlomekFS, answering the questions such as how to store and access the history. On top of the versioning, the possibility of consistent backup is introduced into the file system. New functionality is derived from the analysis of other file systems with similar features and selection of the most suitable approach for zlomekFS.
|
|
|
History and Backup Support for zlomekFS
Wartiak, Rastislav ; Babka, Vlastimil (advisor) ; Obdržálek, David (referee)
zlomekFS is a distributed file system that supports disconnected operation using local cache. During synchronization of local changes it offers easyto-use conflict resolution mechanism. Further improved it became a file system with no specific kernel code. It has therefore a good potential in future public use. As the content of this file system can be updated by many users, keeping history of the changes can be a useful feature. This thesis implements file versioning in zlomekFS, answering the questions such as how to store and access the history. On top of the versioning, the possibility of consistent backup is introduced into the file system. New functionality is derived from the analysis of other file systems with similar features and selection of the most suitable approach for zlomekFS.
|
|
|
Distributed P2P Data Backup System
Mészáros, István ; Herout, Adam (referee) ; Szőke, Igor (advisor)
Tato diplomová práce představuje model a prototyp kooperativního distributivního systému zálohování dat založeném na P2P komunikační síti. Návrh systému umožňuje uživatelům přispět svým lokálním volným místem na disku do systému výměnou za spolehlivé úložiště jejich dat u jiných uživatelů. Představené řešení se snaží splnit požadavky uživatelů na ukládání dat, zároveň však také řeší, jak se vypořádat s mírou nepředvídatelnosti uživatelů ohledně poskytování volného místa. To je prováděno dvěma způsoby - využitím Reed - Solomon kódů a zároveň také tím, že poskytuje možnost nastavení parametrů dostupnosti. Jedním z těchto parametrů je časový rozvrh, který značí, kdy uživatel může nabídnout předvídatelný přínos do systému. Druhý parametr se týká spolehlivosti konkrétního uživatele v rámci jeho slíbeného časového úseku. Systém je schopen najít synchronizaci ukládaných dat na základě těchto parametrů. Práce se zaměřuje rovněž na řešení zabezpečení systému proti širšímu spektru možných útoků. Hlavním cílem je publikovat koncept a prototyp. Jelikož se jedná o relativně nové řešení, je důležitá také zpětná vazba od široké veřejnosti, která může produkt používat. Právě jejich komentáře a připomínky jsou podnětem pro další vývoj systému.
|
guest ::
